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MAXIMIZING  STATIONARY  UTILITY  IN  A  CONSTANT  TECHNOLOGY* 

by 

Richard  Beals**  and  TJalling  C.  Koopmans*** 

1.  Intrcxiuction 

This  paper  16  concerned  with  a  problem  in  the  optimal  control 
of  a  nonstochastic  process  over  time.  It  can  also  be  looked  on  as  a 
problem  in  convex  programming  in  a  space  of  infinite  sequences  of  real 
numbers.  Because  the  problem  arose  in  the  theory  of  optimal  economic 
growth,  the  exposition  will  use  some  economic  terminology. 

The  literature  on  optimal  economic  growth  contains  several 
papers****  in  which  a  utility  function  of  the  form 

00 

(l)  u(x  ,  x  ,  ...)  =  L  at_1u(x  )  ,  0<a<l  , 

1  d  t=l  t 

is  maximized  under  given  conditions  of  technology  and  population  growth. 

Here  x^  is  per  capita  consumption  in  period  t  ,  and  u(x)  is  a 

strictly  concave,  increasing,  single-period  utility  function,  a  is 

called  a  discount  factor.  If  a  =  -r~~r —  .  then  p  is  called  a  discount  rate. 
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A  generalization  of  (l)  has  been  proposed  under  the  name  stationary  utility,* 


*  Koopmans  [i960,  1966],  Koopmans,  Diamond  and  Williamson  [1964]. 


and  is  definable  by  a  recursive  relation 

(2)  U(x^,  Xg,  Xj,  •*•)  =  V(x^,  U(x2>  x^,  «••))  « 


One  obtains  (l)  by  V(x,  U)  =  u(x)  +  a  U  .  The  natural  generalization  of  a 
in  (l)  to  stationary  utility  is  the  function 


(2a) 


a(x) 


dU 


U  <=  U(x,  x,  x,  ...) 


In  this  paper  we  study  the  maximization  of  (2)  under  production 
assumptions,  described  below. 


2.  Definitions,  notations  and  assumptions 

We  assume  discrete  time  t  ,  and  a  single  commodity  serving  as 
capital  (amount  z.  at  end  of  period  t  )  and  also  as  consumption  good 

(flow  x  during  period  t  )  .  Technology  is  constant  and  is  represented  by 

V 

a  production  function  f(z)  .  If  the  labor  force  is  assumed  constant,  f(zt) 

represents  output  in  period  t+1  ,  net  of  depreciation.  If  the  labor  force 
grows  exponentially  at  a  given  rate  X  >  0  ,  and  x^  stand  for  capital 

and  consumption  per  worker,  and  f(z)  represents  output  per  worker  less 
Xz  ,  the  capital  formation  required  in  each  period  merely  to  keep  z^  con¬ 


stant. 


A  capital  path  is  a  sequence  qz  =  (zq,  z^,  . ..)  ,  0  5  z^  <  z  , 

where  0  <  z  <  +  «  ,  We  denote  by  z  the  tail  (z^,  z  ...)  and  by 
z  the  finite  segment  (z  ,  z  z  )  . 

S  u  S  S'  X  t 

A  consumption  path  is  a  sequence,  x  =  (x^,  x^,  »••)  . 
x^.  >  0  .  We  define  the  tail  ,x  and  the  segment  x,  as  above. 

t  zz  u  S 

For  any  constant  a  ,  we  denote  by  a  the  constant  (capital 

con 

or  consumption)  path  (a,  a,  a,  . . .  )  . 


The  capital  path  qz  is  said  to  be  feasible  for  the  initial 

capital  stock  z  if  z  =  z  and 

o 

(3)  zt+1  <  zt  +  f(zt)  ,  t  =  0,  1,  ...  . 


If  qz  is  feasible  for  z  the  associated  consumption  path  ^x  with 


(4) 


{t+i  *  zt  +  ’  zt+i  =  0  *  t  _  o,  1, 

/ 


is  also  said  to  be  feasible  for  z  .  Let  and  .f  be  the 

z  z 

collections  of  capital  paths  and  consumption  paths,  respectively,  which 
are  feasible  for  z  . 


We  assume 

(I)  The  production  function  f(z)  is  continuous  and  continuously 

differentiable  on  the  interval  '  =  [o,  z),  z  ^  »  .  Moreover 

f(0)  =  0  ,  0  <  f  '(0)  ,  f  is  concave,  and  the  function  h(z)  =  z  +  f(z) 

is  an  increasing  function  mapping  (J^onto  itself.  Hence  h(z)  =  lim  h(z)  =  ~z 

z*z 

To  interpret  these  assumptions,  let  F(Z,  L)  represent  total 


output  before  depreciation,  Z  the  total  capital  stock,  L  the  labor  force. 
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The  standard  assumptions  F(0,  L)  =  F(Z,  0)  =  0  ,  F'  >  0  ,  F,'  >  0  ,  Fr'.„  <  0  , 

F  homogeneous  of  degree  1,  then  imply  through  F(Z,  L)  =  Lf(Z/L)  ,  ignorin;; 
depreciation,  that  z  =  »  .  Either  exponential  labor  force  Growth  or  a 
constant  rate  of  depreciation  will  make  z  the  finite  number  defined  by 
f(z)  =0  .  Should  zq  >  z  ,  then  feasibility  requires  z  <  z  +  c  for 

any  e  >0  and  large  enough  t  (see  Figure  l).  From  assumptions  or  U  :ade 


below  we  shall  see  that  optimality  requires  z  <  z  eventually.  On  the  other 

hand,  for  0  <  zq  <  z  ,  feasibility  precludes  z^  if  z  ,  vhereas  zq  =  z 
requires  z^  =  z  .  For  these  reasons  we  consider  only  values  zp  c  . 


We  note  for  future  use  that  if  0  <  z '  <  z  , 

o 

see  Figure  1. 


feasibility  permits  lim 

t-KO 


z 1 
t 


z 


Figure  1.  Two  capital  paths  with  zero  consumption. 


(ll)  U(^x)  is  defined  on  the  union  X  =  LX)£z  of  all 

feasible  sets,  satisfies  the  recursive  relation  (2),  and  is  continuous 
on  each  X  z  with  respect  to  the  product  topology.* 


*  For  a  definition  of  the  product  topology  see  Kelley  [1955  ]>  or  use 

00  t  |xt  “  xtl 

the  distance  function  D(1x,  .x')  =  £8  - 1  i - 1 — n-  >  where  8 

1  1  t=l  1  +  lxt  “  xt' 

is  any  number  with  0  <  8  <  1  . 


An  example  where  U^x)  is  continuous  on  each  X.  z  but  not 
on  X  is  given  below. 

(III)  U^x)  is  strictly  quasi-concave  on  X  • 

That  is,  ^(x)  =  X(jX)  +  (l-xK^x1)  ,  0  <  X  <  1  ,  implies 

U(Lx(x))  >min|u(1x),  uC-j^x ' , 

a  standard  assumption  in  utility  theory.  In  general,  it  expresses  a 
decreasing  desire  for  one  commodity  or  commodity  bundle  relative  to  another 
as  the  other  is  traded  for  the  one  at  a  constant  barter  ratio. 

(IV)  V(x,  U)  has  positive  continuous  derivatives  dv/dx  , 

•  O 

dv/du  ,  on  <J)  xXl,  where  <J)  =  (0,  z)  and  is  the  range  of  U(.jX)  . 


Moreover  V(x,  U) 

is 

continuous  at  x  =  0 

for  all  U  , 

and,  if  V  is 

not  differentiable 

at 

x  =  0  ,  then  lim 

frfr.  u)  -  .. 

OX 

for  all  U  . 

x-K) 

It  follows  from  (II)  and  (IV)  that  U(^x)  strictly  increases 
with  each  x^  . 
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The  purpose  of  the  exception  at  x  =  0  is  to  permit  a  utility 

function  for  which  "  zq  >  0  "  implies  that  "  x^  >0  for  all  t  , " 

A 

where  ^x  denotes  the  optimal  consumption  path. 

From  the  identity  U(cQnx)  =  V(x,  U(conx))  implied  in  (2)  one 

finds  by  differentiation  that  (TV)  implies  0  <  Ct(x)  <  1  for  all  x  >0 

with  x  e  JC  . 
con 


(•■)  (V)  l£t  V2(x,  y;  U)  =  V(x,  V(y,  U))  and 


D(x,  y;  U)  =  -  ,  g  , 

V2(x,  y;  U)  =  const. 


^V2(x,  y;  U)  /dV2(x,  y;  u) 


"Sx" 


dy 


Then,  for  given  y,  U,  D(x,  y;  U)  is  strictly  decreasing  in  x  on  J? 


Together  with  an  assumption  we  will  not  need,  that  D(x,  y;  U) 
strictly  increases  with  y  ,  (v)  is  implied  in  the  following  plausible 
assumption:  The  first-  and  second-period  consumptions  x(b),  y(B)  that 
maximize  V2(x,  y;  U)  for  given  U  if  bought  at  given  positive  prices 
p,  q  within  a  budget  px  +  qy  <  B  ,  are  strictly  increasing  with  B  . 
Economically,  consumption  in  neither  period  is  inferior  to  that  in  the 
other  period,  in  the  way  potatoes  are  inferior  to  steak. 


The  three  assumptions  just  mentioned  are  illustrated  in 


Figure  2. 


z,p  for  t  >  some  large  T. 


-  8  - 


-l 


X 


Taking  e  <  a  -  1  one  sees  that  the  summation  (l)  converges  on  each 

^  f  o  o  2 ' 

hence  on  .X-  .  Note  that  U(^x)  is  not  defined  on  all  of  Is*  ...  , 


and 


is  not  continuous  on  X  if  f(z)  is  not  bounded;  in  fact,  if  u(x)  =  x  ^  , 


the  sequence  of  consumption  paths  with  x^n^  =  0  ,  t  ^  n  and 

x^  '  =  of  converges  to  ^^0  in  the  product  topology,  but 

U(,x^)  =  1  for  all  n  ,  whereas  U(  0)  =  0  . 

'1  '  '  'con  ' 


3.  Optimal  capital  paths 


Given  a  feasible  capital  path  qz  ,  let  ^x  be  the  associated 

consumption  path  given  by  (4).  Define  W(  z)  by  W(  z)  =  U(..x)  .  If 

>  o  o  1 


z  and  z1  are  in 
o  o 


K’ 


then  the  concavity  of  the  production  function 


f(z)  implies  that  a  convex  combination  qz"  =  X(qz)  +  (l-X)(0z')  ,  0  <  X  <  1  , 


and  that  the  associated  consumption  path  ox"  has 


is  also  in<o-  , 

x”  >  Xx^  +  (l-X)x^  for  all  t  .  Ihis  and  the  strict  quasi-concavity  of  U 


imply  that  W  is  also  strictly  quasi-concave. 

A  A  . 

••  A  capital  path  qz  is  optimal  for  z  if  zq  e  ,  and 
W(Qz)  >  W(qz)  for  all  qz  e  . 

A  capital  path  qz  is  rtrictly  monotone  in  time  if  one  of  the 
following  conditions  holds: 


(i) 

zt 

<  Zt+1  5 

t  =  0, 

(ii) 

zt 

=  zt+l  ’ 

t  =  0, 

(iii) 

zt 

>  zt+l  ’ 

t  =  0, 

(iii)n 

>  zt+l  ’ 

t  <  n, 
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The  assumptions  (i)  -  (V)  in  section  2  imply  the  following 
Theorem  1.  For  any  initial  capital  stock  z  e  there  is  a 

A 

unique  optimal  capital  path  qz  .  This  path  varies  continuously  with  z 
and  is  strictly  monotone  in  time. 

If  we  define  h^(z)  recursively  by  h^(z)  =  h(h^n  "^(z))  , 

h^(z)  =  z  ,  then  the  set  z  is  contained  in  the  product  "^-z  of 

(n)  ^ 

the  closed  intervals  [0,  h'  '(z)]  ,  n  =  0,  1,  ...  .  The  latter  set  is 

compact  with  respect  to  the  product  topology,  by  the  theorem  of  Tychonov, 


and 


is  easily  seen  to  be  a  closed  subset,  hence  likewise  compact. 


Continuity  of  U  on 


X, 


implies  continuity  of  W  on 


i 


Then  the 


Z  •  ^  ' 

continuous,  strictly  quasi-concave  function  W  assumes  a  maximum  at  a 


unique  element  qz  of  the  compact  convex  set 


The  remainder  of  this 


section  is  devoted  to  showing  continuity  and  strict  monotonicity  of  this 

A 

unique  optimal  capital  path  qZ  . 


Given  z  £ 


J, 


let  qz  be  the  optimal  capital  path  for  z 


and  set  W(z)  =  W(qz)  . 


Lemma  1.  W(z)  is  strictly  increasing,  and  continuous  from 


the  left. 


Proof.  If  0  5  z  <  z'  <  z  ,  and  if  qz  is  optimal  in 


^  • 


let  z '  € 
o 


,  be  given  by  z ' 
z '  o 


,  z ' 


Then  for  the 


associated  consumption  paths  ^x ' ,  ^x  ,  we  have  x^  >  x^  and  2x'  =  ^  , 
so  W(z')  ^ W(qz ' )> W(oz)  =  W(z)  .  Therefore  W  is  increasing. 


\ 

\ 


£  ** 


i 
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If  0  <  z  <  z  ,  then,  in  the  optimal  consumption  path  ^x 

A  A 

associated,  with  qz  ,  some  x^  is  the  first  to  be  positive.  Then 
z^,  >0  for  0  £  t*  <  t  -  1  ,  and  for  a  sufficiently  small  e  >0  there  is 
a  6  >0  such  that  the  path  ^  ,  x^  -  €  ,  t+]x)  *  ^x  is  feasible 

for  z  -  5  .  Then  U^x)  <  W(z-6)  <  W(z)  .  As  6  0  ,  U(1x)  -*  W(z)  , 

proving  continuity  from  the  left. 


We  can  now  show  that  qz  depends  continuously  on  z  .  Suppose 

z<n)  z  €  (  For  some  z'  c  (J^,  z^  ^  z'  for  all  n  .  Then 
* 

/  v  C  ,  ,  for  all  n  .  Since  the  latter  set  is  compact,  it  suffices 

-  ) z 

to  show  that  any  convergent  subsequence  of  the  corresponding  sequence  of 
~(n)  ~ 

optimal  paths,  z  ,  must  converge  to  z  ,  the  optimal  path  for  z  . 

C(n) 


Renumbering,  we  may  assume  z'  7  itself  converges  to  some 


Z£  j  . 

ir¬ 
respectively,  W(  z)  =  lim  W(  z^)  =  limW(z^n^)  >W(z)  =  W(  z)  ^  W(  z)  . 


By  the  continuity  of  W  ,  Lemma  1,  and  the  optimality  of  z  in  , 

o  _  //  z 


Therefore  W(qz)  «  W(qz),  so^z  =  qz  by  the  uniqueness  of  qz  ,  thus  proving 
continuity  of  qz  . 


Lemma  2.  Suppose  0  :  z  <z'  <  z  ,  and  let  qz  and  qZ ' 


be  the  corresponding  optimal  paths.  Then  either  z^  <  z^  or  z^  =  z| 


z'  =  0  . 


Proof.  Since  z  =  0  implies  z^=  0  the  statement  is  obvious 
in  that  cane. 

Now  assume  0  <  z  .  The  stationarity  of  U  (equation  (2))  implies 

A  A 

that  for  each  t  ,  z  is  optimal  for  z^  •  Therefore  if 

A  A  A  A  A  A 

z1  «s  z^  f  0  ,  then  ^z  *  ^z'  .  Suppose  so,  and  let  ^x  and^x'  be  the 


i 


11 


!Tj 

I 


-  ^  A  A 

f  associated  consumption  laths.  Then  x..  <  x'  and  _x  =  ^x'  .  Write 

i  11  d  d 

A  A  ^  a 

Uj  =  U(^x)  =  U(^x')  .  Then  (x^,  x maximizes  V2(x,  y;  U^)  subject  to 
h(h(z)  -  x)  -  y  =  z„  ,  and  similarly  for  (x,',  x')  .  But  this  is  seen  to 

d  ±  d 

contradict  assumption  (V)  ,  since  *]_  <  >  *2  =  *2  ‘  ^  h(z)  *  ^  = 

A  A 

=  =  h(z')  -  x^  ,  and  in  view  of  the  concavity  of  h  ,  the  strict 

quasi-concavity  of  U,  hence  of  V2  (See  Figure  J). 


<  c-: 
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Iicw  suppose  z^>  z£  >0  .  Moving  from  z  toward  zero  and 
using  continuity,  we  can  find  z"  with  0  <  z"  <  z '  but  with  the 
correspond'  -g  z"  =  zj  ;  see  figure  3(a).  This  was  Just  ohovn  to  be 
inpossible. 

A  ss 

Finally,  suppose  z^  ^  z 1  ■  0  .  Moving  fron  z'  toward  z 

A 

we  get  a  z"  with  z'  >  z"  >z  and  with  the  corresponding  z^'  satisfying 

A  A 

0  <  zj'  <  z^  ;  see  figure  3(b).  But  this  is  the  case  ruled  out  Just  above. 
This  proves  Lenina  2. 

/a 

We  now  prove  monotonidty  of  optimal  capital  paths.  Suppose  qz 

/  A  «  A 

is  optimal  for  z  e  ,  z  >0  .  Suppose  first  that  zq  <  z^  .  Now  ^z  is 

A  A  A 

optimal  for  z^  ,  so  Lemma  2  implies  z^<  zg  .  Inducing,  we  get 

z.  <  z.  for  all  t  .  The  cases  z  •  z,  and  z  >  z,  are  handled 

t  t*i  o  l  o  l 

similarly. 


k»  Asymptotic  behavior  of  optimal  paths, 
in  time  A 

Monotonicity ~of  the  optimal  path  qz  implies  that  the  (possibly 

infinite)  limit  z  ■  lim  z.  exists,  tfe  want  to  determine,  in  terms  of  the 

*  t-  ‘ 

initial  capital  stock  z  ,  when  z  increases, is  constant,  or  decreases*and  what 

z  over  time 

its  limit  is. 


Suppose  the  pair  (x,  y)  maximizes  Vg(x,  y;  U)  -  V(x,  V(y,  U)) 
subject  to  the  constraint  zg  =  h(h(zQ)  -  x)  -  y  ,  where  U  ,  zq,  and  zg 
are  given.  Let  z^  ■  h(zQ)  -  x  and  U2  *  V(y,  U)  .  It  follows  from  the 
usual  analysis  that,  if  x  >  0  and  y  >  0  ,  then 

^  V(x,  U2)  -  ^  V(x,  U2)  •  ^  V(y,  U)  •  <1  ♦  f '(ij) 


(6) 
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\ 


A  a 

If  x  or  y  is  zero,  (6)  is  replaced  by  an  appropriate  inequality. 
Conversely,  (6)  or  the  corresponding  inequality  implies  that  (x,  y) 
is  optimal  for  the  given  problem. 


Similarly  ^xn  with  each  x^.  >  0  maximizes 


^n(lV  U)  =  V(*l'  V^X2#  V<V  subject  to  ^x^  being  obtained  by 


(4)  from  z  with  z  ,  z  ,  LJ  prescribed,  if  and  only  if 
'on  o'  n 


I  V<v  fit+i>  -  ii  V<v  s  ’W’*1  * f '<2t» 


t  =  1,  2,  ...,  n  -  1  ,  where  Ut  =  U)  and  Un+1  =  U 


A  path  qz  with  associated  consumption  path  qX  cannot  be 
improved  by  finitely  many  changes  in  z  ,  t  >  1,  if  and  only  if  the 
corresponding  equations  (7)  hold  for  all  t  .  Itous  qz  cannot  be  improved 
by  finitely  many  changes  if  and  only  if  it  cannot  be  improved  by  a  single 
change . 

Given  z  e  (J ' ,  z  >  0  ,  the  consumption  path  associated  with 

„z  is  x  ,  where  x  =  f(z)  .  Let  U  =  U(  x)  .  If  z  were 

con  con  9  '  '  'con  con 

optimal  we  could  divide  (6)  by  ^  V(x,  u)  to  get 

(8)  o(f(z))(l  +  f'(z))=  1  , 

where  Qt(x)  is  given  by  (2a). 


# 
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Partition  [0,  z]  into  dip  joint  sets: 


-  (  z  |  z  -  0,  z  -  z,  or  a(f(z))(l  +  f ' (z) )  -  1  }  , 

-  (  0  <  z  <  z  |  a(f(z))-  (1  +  f'(z))  >  1  )  , 

=  {  0  <  z  <  z  |  a(f(z))- (1  +  f  '(z))  <  1  }  . 


Then 


is  closed  and 


J>,  f 


are  open.  The  preceding 


shows  that  a  necessary  condition  for  conz  to  be  optimal  if  z  e  c/  is 


that  z  c  / 


We  shall  shov: 


Theorem  2.  Let  qz  be  optimal  for  z  ,  0  <  z  <  z  .  Then 

(a)  if  z  e  '  -  ,  z  is  the  constant  path  z  ; 

—  o  —  -  —  - .  ■*  "  con 

(b)  if  z  c  >  ,  then  z t  increases  and  z^  is  the 

smallest  number  in  J  ~  which  is  larger  than  z  ; 


(c)  if  z  €  1  ,  then  z^  d 

number  in  y  *  which  is  smaller  than  z  . 


>  f'hen  \  decreases  and  z^  is  the  largest 


A  path  qz  optimal  for  z  is  called  stable  if  for  ev«ry  path  qz' 
optimal  for  z'  which  has  z'  sufficiently  near  z  ,  the  limit 

A  A 

z'  «  z  .  We  have  the  following  consequence  of  Theorem  8;  see  Figure  4. 

00  00 


Corollary.  Let  qz  be  optimal  for  z  .  Then  qz  is  stable 


unless  z  e  and  is  also  in  the  closure  of  ( z  • 


|  z  ’  €  (J  >i  z '  > 


or  of 


( z. '  j  z'  e  J'<  ,  z'  <  z)  . 


•  ^ 

Figure  4.  Optimal  paths;  all  except  (b)  and  (f)  are  stable. 

If  z  c  ,  0  <  z  <  z  ,  then  (8)  shows  that  the  equations  (7)  are 

satisfied  by  the  path  z  =  z  .  Therefore  z  cannot  be  improved  by 

con  o  o 

changing  only  finitely  many  of  the  ,  t  >  1  .  Statement  (a)  of 
Theorem  2  is  thus  included  in  the  following 


Lemma  3.  Let  qz  be  a  feasible  capital  path  with  z^  5  z*  <  z 
for  all  t  .  Suppose  W(qz)  ^W^z')  for  all  qz'  with  z^  =  zq  and 


z'  =  z  for  some  m,  n  .  Then  z  is  optimal. 

m  n  -  ’  -  o  - c - 


/ 
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(n)  0<l 

For  any  n  there  is  a  path  z'  e  \  with  zvll/  *«  z"  and  z'"'  =  z 

^  o  /7Z-  onon  m  m 


Proof.  Suppose  qz"  €  ■{  ,  and  suppose  first  that  z "  >  0  ,  all  t 

(n)  I.  .  (n) 

o 
o 

for  sufficiently  large  m  (depending  on  n  ,  z"  and  Qz  ;  this  follows 

(n) 

from  the  last  remark  preceding  Figure  1  above.  Then  W(qz)  >W(qz'  ')  ,  and 
r<n)  ■*>  oz"  so  W(qz)  =  W(oz")  .  If  z*  is  eventually  zero,  choose  0Z^D^ 
similarly  but  with  zfn^  =  max  (z",  e  }  for  t  n  ,  where  e  >0  ,  e  0  . 
Again  we  find  W(qz)  >  lim  W(oz^n^)»  W(qz")  ,  so  qz  is  optimal. 


It  is  clear  from  the  proof  of  Lemma  3  that  the  assumption  that  z^ 

is  bounded  away  from  z  is  stronger  than  necessary.  What  is  needed  is  that 

tz  can  always  be  caught  up  with,  even  from  a  late  and  bad  start.  Some  such 

assumption  is  clearly  necessary,  however,  for  let  z t  **  h^t^(zQ)  ,  all  t  . 

Then  z'  e  A  and  z'  **  z  for  some  n  implies  z 1  =  z  .  Thus  z 
o  ^  zQ  n  n  *oo 

cannot  be  improved  by  finitely  many  changes,  since  it  cannot  be  changed  in 

only  finitely  many  places.  However  the  associated  consumption  path  is 


0  ,  so  z  i6  strictly  inferior  to  any  other  path  in 
con  ’  o  J  /z. 


1 


Next  we  consider  the  effect  of  finitely  many  changes  in  z 

con 


when  z  e 


Lemma  4.  Suppose  z  e 


0 


.  If  qz  e  <  and  z^  <  z  for 


t  <  n  ,  while  z  =  z  ,  then  W(  z)  5  w(  z)  .  Moreover,  equality 

>  -  n  con  >  -  '  -  'con  •  - 1 - 3 - i. 


holds  only  if  z 


con 


t 
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Proof.  We  induce  on  n  .  By  assumption  zq  *  z  ,  so  for  n  **  1 

there  is  nothing  to  prove.  Suppose  the  statement  is  true  for  n  =  m  >  1 

and  suppose  z,  5  z  for  t  <  m  while  , ,  z  *  z  .  If  z  =  z 
t  =  =  ntf-1  con  m 

then  z  o  z  and  the  statement  holds,  by  assumption.  Suppose  z  <  z  . 
m  con  m 

")  . 

Choose  a  path  z'  e  -1  with  z '  =  z  ,  t  *  m  and  z'*z  +  6,8>0. 

*  o  z  t  ’  r  m  * 

The  corresponding  value  of  W  satisfies 


W(  z')  -  W(  z)  = 
'o  '  'con 


dv 

5S 


(x,  U)£a(x)(l  +  f'(z))  -  1]  *6  +  c(8)*B  , 


where  x  =  f(z)  ,  U  =  W(ccnz)  ,  and  «t(6)  -►  0  as  8  -►  0  .  Since  z  e  , 

the  factor  in  square  brackets  i6  positive.  Therefore,  for  small  positive  8  , 

W(  z')  >W(  z)  .  Now  z  <  z  <  z'  ,  so  there  is  a  convex  combination  z" 
'o  '  'con  ’  m  m  ’  o 

“  X(qz)  +  (l-X)(oz')  with  z^  =  z  .  Clearly  z£  <  z  for  t  <  m  and 

z"  »  z  .  The  induction  assumption  implies  that  W(  s")  5  W(  z)  . 
m  con  'o  'con 

Strict  quasi-concavity  of  W  implies  that  W(qz")  >  min  {W(qz),  W(qz'))  , 

but  W(qZ')  >w(COn2^  =  W(0Z")  >  80  W(0Z")  >  W(QZ)  •  Therefore 

W(conz)  >M<oz)  ’  completing  the  proof. 


A  similar  argument  shows  that  if  z  c 


S'. 


any  change  in  z 
con 


moving  finitely  many  z upward  is  a  change  for  the  worse. 

We  can  now  prove  (b)  of  Theorem  2.  Suppose  z  e 


and  let  z 
o 


be  the  optimal  path  for  z  ,  We  know  that  qz  is  not  constant,  so  it  either 
increases  or  decreases.  Suppose  it  decreased.  As  in  the  proof  of  Lemma  3  , 
there  would  be  a  sequence  of  paths  oz^n^e  ^  such  that  ♦  Qz  , 

z.fn^  =  z  for  all  t  ,  and  z^ 
t  m 


con 


/•' 

z  for  large  m  .  By  Lemma  4, 


**  • » 


\ 
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W(  2<n)  <  W(  z)  ,  all  n  .  Therefore  W(  z)  5  W(  z)  .contradicting 
'o  =■  'con  ’  'o  '  -  'con  ’  ^ 

A 

the  unique  optimality  of  z  ,  since  z  in  noncptinal  Tims  z  increases. 


Let  z'  be  the  smal test  number  in 


which  is  larger  than  z  . 


—  — 

If  z '  *  z  then  certainly  z  b  z '  .  if  z '  <  z  ,  then  z '  is  optimal 

oo  '  con 

A 

for  z'  and  repeated  application  of  L*. nna  2  shows  that  z  <  z'  for  all  t  . 

^  .  A  —  ^ 

Thus  again  z  _  z'  .  Suppose  z  =  z"  <  z  .  Then  _z  satisfies 

00  “  00  X 

A 

equations  (7)  for  large  T  and  all  n  ,  if  we  write  Un+1  a  W(  n  ^z)  .  But 

A 

^z  rrnz"  .  By  continuity  ^z"  will  also  satisfy  equations  (7)  , 


with  U  ..  =  V/(  z')  ,  so  z"  e 

n+1  'con  '  * 


Then  z"  =  z‘  .  This  completes  the 


proof  of  (b),  and  the  proof  of  (c)  is  exactly  parallel. 

A  A 

If  qz  is  an  optimal  capital  path  and  x  is  the  associated 

A 

consumption  path,  then  x  obviously  has  the  following  properties: 


A  .  .  -A 

<  f(ztJ  if  z^  increases j 


x  >f(z  )  if  z  decreases; 

X*  — -  v 


lim  xt  =  lim  f(z^)  . 

t-*O0  t>00 


II  is  "  clear  whether  cur  assumptions  guarantee,  that  x^  is  also 
monotone  with  respect  to  tir.c.  It  is  monotone  when  U  has  the  special 
form  (l),  see  equation  (7) 
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5*  Construction  of  optimal  paths 


We  give  two  procedures  for  constructing  the  optimal  capital 
path  as  a  limit  of  a  sequence  of  paths  each  obtained  by  solving  the 
optimization  problem  for  finite  time.  Each  procedure  has  certain  dis¬ 
advantages,  theoretical  or  practical. 

qz  e  tyj  „  and  an  integer  n  >  1  ,  let  T^(^z) 


Given  a  path 


'£  % 


be  the  path  z  _  , ,  _  . . 

o  V  z  '  o 


z  w  n'o 

which  maximizes  W(  z')  with  contraints 


oZ  n-1  =  ozn-l  ’  n+l“  "  n+1 


z'  =  ,.z  .  Thus  T  (  z)  is  obtained  from  z 

n-i-T  m  '  r\  •  r\ 


n'o 


by  making  the  best  feasible  adjustment  in  z^  alone.  Then  Tr  is  an 


operator  from  to  'A  .  Note  that  W(T  (  z))  >W(  z)  ,  with 

r  <r 


n'o  "  -  'o 


equality  only  when  T  (  z)  =  z  . 

no  o 


Let  S  be  the  iterated  operator  S  =  T  T  ..  . . .  T-  , 
n  n  n  n-1  1  ’ 

and  suppose  z  e  ,  z  >0  .  Start  with  some  path  Qz^°^  in  ^)2 
and  define  a  sequence  of  paths  inductively  by 


z("+l)  =  3  z(n))  . 

o  n+l'o  ' 


Thus  oz<n+l)  is  obtained  by  improving  Qz^n^  the  first  n+1 
places,  in  order.  We  cannot  be  sure  that  will  converge  to 


the  optimal  path  qz  ;  in  fact  if  we  make  the  unfortunate  initial 
choice  z^°^  =  h^^z)  for  all  t  ,  then  there  is  no  room  for  finite 
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1 


change,  so  for  all  n  ,  and  is  inferior  to 

O  O  0 


any  qz  e  * 


Some  subsequence  qz 


(n,  J) 


will  converge  to  a  path  qz  e 


This  path  cannot  be  improved  by  a  single  change,  so  it  cannot  be  improved 
by  finitely  many  changes.  In  fact  W(oz^n^)  is  nondecreasing,  and 


w(nz(m))  swer^zM))  s  w(sm^1(oz(m)))  =w(^z(m+l))  , 


rrH-l',o 


so  W(T^(qz))  =  W(qz)  .  Hence,  by  strict  quasi-concavity  of  W  ,  the 
adjustment  of  z^  in  the  definition  of  T-^^z)  leaves  z^  unchanged, 
and  T1(qz)  =  ^z  .  Inductively,  suppose  T^(qz)  =  ^z  for  j  <  n  .  Then 

Tn+l^oZ^  =  Sn+l^o2^  ’  and  the  Same  ar6ument  Bhows  W(Tn+l(0Z^  =  W(QZ)  > 

£.  _ 

so  T  .(  z)  s  z  .  If  z.  <  z  <  z  for  all  t  ,  then,  by  Lemma  3, 

n+l'o  '  o  t  =  ’  ’  J  y> 

qz  is  optimal.  Moreover,  if  qz  is  optimal,  then  any  other  convergent 
/  \ 

subsequence  of  '  will  converge  to  a  qz  '  with  W(oz')  =  W(  z)  . 

(n) 

Hence  the  whole  sequence  qz'  '  will  converge  to  qz  .  As  noted  above, 

the  limit  need  not  be  optimal,  however. 

An  optimum  can  be  guaranteed  by  the  following  method.  Given 
z  e  with  z  >  0  ,  choose  some  z1  e  J  .  (A  computationally 

helpful  choice  of  z 1  is  the  z  of  Theorem  2,  provided  z  <  z  . ) 


For  some  N  there  is  a  path  z'  e 

o 


'  H  with  „z '  =  z '  .  For 
Az  N  con 


any  n  >N  there  is  a  unique  z^  c  -}i  maximizing  W(  z)  subject 

r 
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to  z  =  z'  .  Let  z  be  optimal  for  z  .  As  in  the  proof  of 
n  con  o 


Lemma  3  there  is  a  sequence  of  paths  ^2 


(n) 


such  that,  for  each 


n  ,  the  tail 


:(n) 


m 


is  eventually  z'  .  Then  W(  z^n^)  =  W(  z^ra^)  , 


con 


so  lim  W(  z^m))  =  W(  z)  .  It  follows  that  z 
'o  'o  o 


(m)  ^ 


z  . 


The  practical  difficulty  with  this  method  is  that  it  involves 
solving  optimization  problems  for  more  and  more  time  periods,  rather 
than  for  one  period  at  each  step  as  in  the  first  method.  Let  us  note 
that  each  such  problem  can  be  solved  by  iterating  the  one  period 
solution.  Suppose  0Z^°^  €  ^hz  and  n  >  1  .  A  modification  of  the 

argument  above  shows  that  z^  =  (S  )m(  z^0^)  converges  to  the 


path  z 1  e 
o 


n' 

W(  z‘)  subject  to  -.Z1  =  ,z^°^ 

'o  '  ^  n+1  n+x 


which  maximizes 
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